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Abstract 

m 

Consider the nonlinear matrix equation X- 2 A?X A* = Q. This paper shows that there exists a 

unique positive definite solution to the equation without any restriction on A, . Three perturbation 
bounds for the unique solution to the equation are evaluated. A backward error of an approximate 
solution for the unique solution to the equation is derived. Explicit expressions of the condition 
number for the unique solution to the equation are obtained. The theoretical results are illustrated 
by numerical examples. 

Keywords: nonlinear matrix equation, positive definite solution, perturbation bound, backward 
error, condition number 



1. Introduction 



In this paper the nonlinear matrix equation 



X-^A*X- l Ai = Q 



(1.1) 



is investigated, where A\, A2, . . . , A m are n x n complex matrices, m is a positive integer and Q is 
a positive definite matrix. Here, A* denotes the conjugate transpose of the matrix A, . 

This type of nonlinear matrix equations arises in many practical applications. The equation 
X - A*X~ l A = Q which is representative of Eq. fll.U for m - 1 comes from ladder networks, 
dynamic programming, control theory, stochastic filtering, statistics and so forth 
13411 . When m > 1, Eq. dl.U is recognized as playing an important role in solving a system of 
linear equations in many physical calculations. 

For the equation X + A*X~ l A = Q, there were many contributions in the literature to the 
theory, applications and numerical solutions jgj [Tol IT2I , |l 3[ 15 , 16 , 20[ 28 , 31, 35[ 37||. The 
general equations such as X + A*X~ 2 A = Q iflj, \m \M Bl, X s ± A*X~'A = fill HlS H 
andX + A*X- c 'A = qMMM 

were also investigated by many scholars. In addition, He and 
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— I j — i m 

Long 11711 and Duan et al. [8] have studied the similar equation X + £ A*X~ l A, = I. sarhan 



et al. B27H discussed the existence of extremal positive definite solution of the matrix equation 



m j — i m 

X r + 2 A*X 5i Ai = /. Duan et al. M proved that the equation X - £ A*X d >A t = Q (0 < \6 t \ < 1) 

i=i i=i 
has a unique positive definite solution. They also proposed an iterative method for obtaining the 

unique positive definite solution. However, to our best knowledge, there has been no perturbation 

analysis for Eq. dl.ll ) in the known literatures. 

The rest of the paper is organized as follows. Section 2 gives some preliminary lemmas that 
will be needed to develop this work. Section 3 proves the existence of a unique positive definite 
solution to Eq. dl.ll ) without any restriction on A,. Section 4 gives three perturbation bounds for 
the unique solution to Eq. dl.ll ). Section 5 derives a backward error of an approximate solution for 
the unique solution to Eq. dl.ll ). Furthermore, in Section 6, the condition number of the unique 
solution to Eq. dl.U is discussed. Finally, several numerical examples are presented in Section 7. 

We denote by C nxn the set ofnxn complex matrices, by f{ nxn the set of n x n Hermitian 
matrices, by I the identity matrix, by i the imaginary unit, by || ■ || the spectral norm, by || • Un- 
file Frobenius norm and by A m . dx (M) and A m \ n (M) the maximal and minimal eigenvalues of M, 
respectively. For A = (a\, . . . , a„) = (ay) e C" x " and a matrix B, A® B - (a/jB) is a Rronecker 
product, and vecA is a vector defined by vecA = {a[, . . . ,al) T - For X, Y e <J-(" X >\ we write 
X > T(resp. X > Y) if X - Y is Hermitian positive semi-definite (resp. definite). 

2. Preliminaries 

Lemma 2.1. $2^. IfA>B> 0, then < A -1 < B l . 

Lemma 2.2. %2(kl . For every positive definite matrix X e <H" xn , ifX + AX > ( l/v)X > 0, then 
\\X-^A*((X + AXy 1 -X- l )AX^\\ < (\\X-iAXX- 1 z\\ + v||X _ 5AX;H|| 2 )||;HajH|| 2 . 



Lemma 2.3. 4771/ . The matrix differentiation has the following properties: 

(1) d(F x ±F 2 ) =dF x ±dF 2 ; 

(2) d(kF) — k(dF), where k is a complex number; 

(3) d(F*) = (dF)*; 

(4) d(FiF 2 F 3 ) = (dF l )F 2 F i + Fi(dF 2 )F 3 + F l F 2 (dF 3 ); 

(5) dF' 1 = -F-\dF)F- { ; 

(6) dF — 0, where F is a constant matrix. 

3. Positive definite solution of the matrix Eq.(l.l) 

In this section, the existence of a unique positive definite solution of Eq. dl.ll ) is proved. 
Moreover, some properties of the unique positive definite solution of Eq.i rTTTT ) are obtained. 

m m m 

Theorem 3.1. IfF(X) = 2+2 ATX^A,-, then F([Q, Q + 2 ATfi-'A,]) c [Q, Q + £ A'g-'A,]. 

i=\ i=l 1=1 



Proof. LetQ = [Q, Q+ £ ATQ^A,-]. By Lemmal2TT1 we obtain < X~ l < Q l for every X e Q. 

i=i 

m 

Applying Eq.(0 yields Q < F(X) <Q+£ A*Q _1 Aj. Therefore F(Q) c a □ 

i=i 

2 



Theorem 3.2. There exists a unique positive definite solution X to Eq. il.lt and the iteration 

m 

X Q >0, X n = Q + ^ j A*X;\A i , n=\,2,--- (3.1) 

i=l 

converges to X. 

To prove the above theorem, we first verify the following lemma. 

m m 

Lemma 3.1. Let F(X) = Q + £ A'X-%. I/O < t < 1 andX e [Q,Q+ £ A*Q- l A{\, then 

i=l i=l 

F\tX)>ta+ri(t))F\X), 



where 



(l-t)A min (Q) 



«W(Q) + - 



<W(0 



Proo/. According to TheoremKUl for every X e [Q, Q + £ A*g A,], we have F(X) e [Q, Q + 

i=i 

m m 

2 A.*G _1 Ai] and F 2 (X) e[Q,Q+Z A*.Q~ l A^. Hence we have 

i=i i=i 

F\tX)-t(l+T}(t))F 2 (X) 



= (i - dq + 1 2 a; (?e +2]A?jr l A j )- 1 - (e +Y J A*x- 1 A i r 1 



Ai 



d-t)A mm (Q) _ p2(x) 



£ /tmax(A*A|) 



> (l-fHnm(G)/- 



(1 ~ Q/tnun(0 

+ i= '^ in (0 



<Vax(<2) + 



1=1 

^min(e) 



/ = 0, < t < 1. 



□ 



Proof of TheoremE^] LetF(X) = 2 + t AIX^A, and Q = 2 A'g'A,]. The proof 

i=i i=i 

will be divided into two steps. 

(1) We prove the special case of Theorem l3 . 21 when Xq = Q. 
It is easy to check that 

m m 

Q<X 1= Q + Y J A*X- ) l A i = F{Q) = Q + ^A*Q -1 Af, 



!=1 



i=l 



6 < ^2 = e + £ A^'A, = F 2 (0 < F(Q), 



1=1 



F 2 (Q) <X 3 = Q + ]T A]X^Ai = F\Q) < F(Q), 



i=] 
m 

f\q) <x 4 = q + ^ a;x 3 - 'a, = f\q) < f\q). 

By induction, it yields that 

m 

Q < F 2k (Q) < F 2k+2 (Q) < F 2k+ \Q) < F 2k -\Q) < Q + Y A*Qr l A u k e Z + . 

1=1 

Hence the sequences {F 2k {Q}} and {F 2i+1 (0} are convergent. Let lim F 2k (Q) = X m , lim F 2k+l (Q) 
X (2) . It is clear that X m and X (2) are positive fixed points of F 2 (X). 

In the following part, we first prove that X (l) = X (2 \ Suppose that Y\ and Y 2 are two positive 
fixed points of F 2 in Q. We compute 

, m 

Yi = F 2 (Y,)>Q> (Q + YjA;Q-%) 

Z Amax(A*Ai) 1=1 
1 '=l 

1 + 5 

■ (0 

mm x ' 

1 , 1 



F\Y 2 ) = tY 2 , t = 
1 A max (A*A,) 2 >W(A?A f ) 

1 + : 1 + 



^ • (0 $ • (0 

Let to = sup{r|Fi > tY2}. Then 1 < to < +00. On the contrary, suppose that < to < 1, Then 
Ti > fo^- According to Lemma [37X1 and the monotonicity of F 2 (X), we have 

Yi = F 2 (Y X ) > F 2 (t Y 2 ) > (1 + /7(?o))?oF 2 (F 2 ) = (1 + ^o))^. 

By the definition of 77(f), we obtain (1 + rj(to)) to > to, which is a contradiction to the definition 
of to. Hence we have to > 1 and Y\ > Y 2 , Similarly, we get Y\ < Y 2 . Therefore Y\ = Y 2 , i.e., the 
equation X = F 2 (X) has only one positive definite solution. Hence X m — X (2) . 

Second, we prove that lim X n is the unique fixed point of F in £2. By X {V) = X (2) , it follows 

that X m = X (2) = lim F"(0 is the unique fixed point of F 2 . Moreover, the positive definite 

n—*oo 

solution of equation F(X) = X solves X = F 2 (X). Therefore F(X) = X has only one positive 
definite solution and lim F"(Q) = lim X„ is the unique fixed point of F. 

(2) We prove the case of Theorem l3.2l when Xo > 0. 
From iteration ( 13.11 ). we obtain 

Xi > Q, 



m m 

Q<X 2 = Q + Y J A*X- l x A i <Q + YjA'Q-% = F(0 



and 

m 

F\Q) < X 3 = / + 2 A'X^Ai < F(Q). 

!=1 

By induction, we have 

F 2k (Q) < X 2k+X < F 2k - l (Q) and F 2k -\Q) < X 2k < F 2k -\Q). 



Therefore 



lim X k = lim F"(Q). 

k— >oo n— »oo 



It follows that lim X^ is the unique positive definite solution of Eq. fll.lb . □ 

HI 

Theorem 3.3. IfX is a positive definite solution of Eg ALU , then Q < X < Q+ £ A*Q~ l Aj. 
Proof. That X is a positive definite solution of Eq. fll.ll ) implies X > 0. Then X" 1 > and 

m 

A*X- l Ai > 0. Hence X = Q + £ A;x 'A, > g. Consequently, X~ l < Q~ x and X < Q + 

i=i 

m 

i=i 

Theorem 3.4. Every positive definite solution X of Eg. ( 17771 ) z'i zn [/?/, a-/], where a and fi are 
respectively the solutions of the following equations 

m 

2 ^max(A*A,) 

X = -W(0 + " , (3.2) 

2 ^mi„(A;A,) 

^mia(G) + — 

x 

m 

2 ^min(A*A,) 

x = A min (Q) + - . (3.3) 

2 ^max(A*A ! ) 

^max(G) + — 

X 

Moreover, 

A min (Q) < p < a. (3.4) 
Proof. We define the sequences \a„} and \/3„) as follows: 

2 ^max(A;A,) 2 ^min(A*A,) 

ySo = ^min(g), a„ = A max (Q) + — , /3, !+ i= A min (Q) + — , n = 0, 1,2, •■ ■ . 

(3.5) 



5 



From (13.51). it follows that 



2 ^max(A*A,) 

A) < A m . dx (Q) <a = A max (Q) + — — — — , 



2 ^min(A*A,) 2 ^ min (A;A,) 



Afflta(G) = A < A = A mm (Q) + < A min (Q) + 



ao A max (0 

m m 

2 U(A;Af) 2 ^ max (A*A,) 

A) ^ ^max(G) ^ «1 = <W(0 + ~ 7j < ^max(0 + — ~ 77^ = C*0- 

A /lmin(y) 

m 

S ^ mm (A;A,) 

We suppose that /i ma x(0 < a* < ffjt-i and /i min (0 < A-i ^ A < imin(G) + ^— — — . Then 

m 

2 ^min(A*A,) 

^min(e) < a = <W0 + - 

CXk-1 

m m 

2 AminCA'A,) 2 ^min(A*A ; ) 

< A+l = ^min(0 + < A min (Q) + — — — , 

Uk /tmax(0 

m 

2 ^max(A*A,) 

<Vax(0 < OSk+\ = /lmax(0 + ~ " 

Pk+1 

m 

2 A m , x {A*A,) 

< a k = /t max (0 + - • 

Pk 

Z ^(A'Aj) 

Hence, for each we have A lmx (Q) < a k +i < a k and A min {Q) </3 k < A+i < A min (Q) + ■ 



which imply that the sequences {a„} and {/?„} are monotonic and bounded. Therefore, they are 
convergent to positive numbers. Let 

a = lim a n , ft = lim A- 

n— »oo n—*oo 

Taking limits in ( 13.5b yields 

m m 

2 ^max(A*A,) 2 A mm (A*Ad 

a = ^max(0 + - - , y8 = ^ min (0 + - , (3.6) 

p a 

which imply 

m m 

2 ^max(A*A,) 2 ^min(A*A;) 

a = i m ax(0 + — ; , P = ^min(0 + = ' 



<WG) + <W(fi) + * 

6 



Therefore a and ft satisfy (13.21 ) and ( 13.3b . respectively. We will prove that X e [ftl, al] for any 
positive definite solution X. According to Theorem l3.3l and the sequences in ( 13.5b . we have 

m 

2 /W(a;a,) 

ft I<Q<X< OWG) + ' =1 : )/ = aro/ 

m m 

for each positive definite solution X. FromX =2+2 A*X _1 A,-, it follows thatX = 2+2 A*(2 + 

i=l ~ i=l 

m 

2 ArX-'A/J-'A,. Hence 



A mia (Q) + 



2 ^min(A;A,) 
i=l 

/ tmax(2) ^ /),„;„ (X) > 



I < X < 



^max(G) + 



2 ^max(A*A;) 
i=l 

| i mi „(A*Ai) 
^minCG) "! / | nlax (X) > 



(3.7) 



Using /?o/ < X < oqI, we obtain fto < A m { n (X) and /l ma x(^) ^ <xo- Applying the inequality in (13.7b 
yields < X < ail. By induction, it yields that ft„I < X < a„I. Taking limits on both sides of 
the above inequality, we have ftl < X < al. □ 



Corollary 3.1. Every positive definite solution ofEq. ( 17.71 ) is in 

where a and ft are defined as in Theorem \3.4\ 



. m . m 

e + -^A;A, e + -2>,% 

1=1 ^ i=i 



Proof. We suppose that X is a positive definite solution of Eq. dl. lb . By Theorem l3.41 it follows 
that 

A min (Q) < ft < A min (X), A m , x (Q) < A m , x (X) < a. (3.8) 

m m 

2 a* A 2a*a ; 

Using X = g + 2 A*X 'A;, we obtain Q + — < X < Q + - — — . Applying inequality 

i=l ^maxW AninW 



(l3~8l l yields g + - ^ A*A, < X < Q + - ^A*A,-. 

a i=i ^ i=i 

Remark 3.1. Applying ( 15.7 b , we obtain 

1 m 

e + ^X A -A^ 



□ 



!=i 



^max(0 + 



^min(g) + 



2 A max (A*A,) 

i=l 



2 ^(A'A,) 
i=l 



I = al, 



I =01. 



That is to say, the estimate of positive definite solution in Corollar\ \3.1\ is more precise than that 
in Theorem\3.4\ 



7 



4. Perturbation bounds 



Here we consider the perturbed equation 

m 

X-Y^AiX-% = Q, (4.1) 

i=i 

where A,-, Q are small perturbations of A, and Q in Eg. ( II. II ). respectively. We assume that X and 
X are the solutions of Eg. ( II. II ) and Eg. ( 14.11 ). respectively. Let AX - X - X, AQ = Q - Q and 

AA; = A/ - A;. 

In this section we develop three perturbation bounds for the solution of Eg. (II. 11 1. To begin 
with, a relative perturbation bound for the unique solution X of Eq. dl.ll ) is derived . The pertur- 
bation bound in Theorem [4T| does not need any knowledge of the actual solution X of Eq. dl.U . 
Secondly, based on the matrix differentiation, we use the techniques developed in [8j] to derive 
another perturbation bound in Theorem 14.21 Finally, based on the operator theory, we obtain a 
sharper perturbation bound in Theorem l4.3l 

The next theorem generalizes Theorem 3.2 in Li and Zhang [20] with m — 1 to arbitrary 
integer m > 1 . 

m m 

Theorem 4.1. Letb=p 2 +/3 \\AQ\\ - £ ||A,|| 2 ,s = £ ||AA,|| (2||A,|| + ||AA,||). // 

i=i i=i 

0<b<2/3 2 and b 2 - 4{3 2 (J3 \\AQ\\ + s)>0, (4.2) 



then 
where 

Q = 



\\x-x\\ 
\\x\\ 



KgJ^WAAiW + ajWAQW^Zu (4.3) 



/=i 



2s 2/3 



2 \\AAi\\(b + yjb 2 - 4/3 2 (0 \\AQ\\ + s)) b + V^ 2 - 4 /? 2 (fi ll A 2ll + *) 



i=i 

Proof. Let 

m 

Q. = {AX e <H" X " : ||X" 1/2 AXX" 1/2 || < g Y ||AA,|| + w||Ag|| }. 

i=i 

Obviously, Q is a nonempty bounded convex closed set. Let 

m 

f(AX) = Y^(Ai*(X + AXY l Aj - A*X- l Ai) + AQ, AX e Q. 

/=i 

Evidently, / : Qh <7Y" x " is continuous. We will prove that /(Q) £ Cl- 
in 

For every AX e Q, that is p- 1/2 AXX- 1/2 || < g £ l|AA,|| + wllAgll. Thus 

i=i 



X- 1/2 AXX- 1/2 > (-g £ ||AA,|| - wllAQII)/, 



i=i 



X + AX^d-Q^WAAiW-coAQWW. 
According to ( 14.2b and ( 14.3b . we have 



i=i 



e^HM-ii+MiAeii 



2(J3 \\AQ\\ + s) 



Therefore 



b+ V^ 2 -4/3 2 (J3\\AQ\\ + s) 



2Q6 jjAgjj + j) < 

b ~ 2/3 2 



(l-gJ]\\AA i \\-co\\AQ\\)X>Q. 

!=1 

From Lemma [2T2l and X > it follows that 

r m 

Y A* ((X + AXT 1 - X~ l )Ai x- 



Therefore 



Y^A*((X + AXT 1 -X~ l )A 
1=1 

WX-'iAXX-i 



h\\2 



1-0 E IIAA/H - MIAgll 

Wx-'i axx-^w 2 



2 ii^^jz- 



1-0 E IIMill - wHAfiH 

i=i 



||X~2AXX~2|| + 
\\X~T-AXX~T-\\ + 

Z-V(AX)X4|| 

m 

X"5 YA*{iX + AX)~ 1 -X- 1 )A i X~^ +X-^AQX~i 

-i=i 

/17 

^Z-^CCX + AZ)" 1 -X'^AiX-i +|IX~sAfiX~5|| 
i 

in 

^ X^- [AA*{X + AX) _1 (Ai + AAj) + A*(X + AX)" 1 AA,] X~ 



\\X~iAXX- 



\\X—2AXX- 



i-eIIIMII-MIA(2ii 

i=l 



( y m 



E l|AA,-||(2||Aj|| + ||AA,-||) 

j=i llA<yn 



y6 2 (l-p E IIAA/H - MIAgll) 

i=i 



P 



ft + 



1 -fij 



1 m 

- X l|A,|| 2 
" i=i 



* + IIAfill 



£ 2 (l-ft) P 



= ft. 



That is f(fl) Q O. By Brouwer fixed point theorem, there exists a AX e Q such that f(AX) = AX. 
Moreover, by Theorem 13.21 we know that X and X are the unique solutions to Eq. dl.lt and 
Eg. (14. It . respectively. Then 



||AX|| \\X l/2 (X~ l/2 AXX- l/2 )X 



1/2,, 



\\x\\ \\x\\ \\x\\ 



< \\X- l/2 AXX- 1/2 \\ < g £ HAAiH + w||Ag||. 



□ 



Remark 4.1. With 



2(2||AA l -||(2|H J || + ||AA j ||)+^||Aj2||) 

q V ||AA,|| + «)\\AQ\\ = — = , 

tt b+ ^b 2 -4/3 2 (/3\\AQ\\ + s) 

m 

we get q £ IIAA/H + u\\AQ\\ -> as AQ -> and ||AA,|| -> (i = 1,2, • • • ,m). Therefore 
Eq. il.lt is well-posed. 



Next, with the help of the following lemma, we shall derive a new perturbation bound as 
shown in Theoreml4.2l 



Lemma 4.1. Suppose that X is a unique positive definite solution of Ea. ( 17771 ). Tjf 

m 

J^WAtW 2 </3 2 , (4.4) 

f/zen 

m 

^I(IIAilllkiAill) 
\\dX\\ < 1=1 - . 



P 2 - 2 IMP 

Proof. According to Lemma l2~3l differentiating on both sides of Eq. dl.ll ), we have 



dX - Y^dA'iX^Ai) - (A*X- l )dX(X- l Ai) + (A*X~ 1 )dA i ] = 0. 

i=\ 

m m m 

dX + ^(A,-X- 1 )dX(X _1 A,) = Yj dA*(X- l Ai) + ^(Apr^Aj 

i=l i=l 1=1 

m m m 

\\dX + Yj^A'X-^dXiX-'AdW = || dAliX-'Ad + J^A**- 1 )^;!! 

1=1 i=l i=l 

m m 

£ Hallux- 1 miAiil + ^||A*||||X- 1 ||||rfA ! -|| 



1=1 

Therefore, 



and 



< 

i=i 



2£||A / ||||X- 1 |||| £ /A,|| 



/=i 
10 



are true. By Theoreml3~4l it follows that < \. Then 



\\dX + ^(AlX-^dXiX-'AM < - £ IIA/HHdAill 



(4.5) 



In addition, 



\\dX+ Yf.A'X-^dXiX^AdW > \\dX\\ - \\YjA*X- x )dX{X- x A^) 

i=l 1=1 



( m \ 

2 



|kff|| - J] KA'X-^dXiX-'AM > \\dX\\ -i^ ||Ai 



1 ~ ^2 Z l|A ' 112 l|flfX|1 ' 



|kK|| 



(4.6) 



By gill, it follows that ||A,|| 2 )||t/X|| > 0. 



i=l 



Combining ( 14.5b and (14.6b . we obtain 



P ;_i P 



which means that 



2p-£(||A,|||k/A,| 

i=l 

y6 2 - 2 \\Ai\\ 2 

1=1 



□ 



Theorem 4.2. Suppose that X, X are the unique positive definite solutions of Eg. ( 17771 ) one/ £g. 
( 14.71 ), respectively. If 



£||A,|| 2 <yS 2 anrf £(||A,|| + ||AA,||) 2 </? 2 



(4.7) 



then 



and 



hold true. 



\\x-x\\< 



2/5 2(1^11 + ||AA,||)||AA,i 

i=i 

m 

P^-KIIAiH + IIAAill) 2 

i=i 



vll 2/3 EClHill + IIAAilDIIAAdl 
I|a - a|| ,=] _ 

m ^ 



11*11 



OS 2 - 2(1^-11 + HAA/ID^IIXH 

!=1 



11 



Proof. Set A,(f) = A, + ?AA,, t e [0, 1]. By Theoremll2l we have that for arbitrary t e [0, 1], the 
matrix equation 

m 

X-Y J A*(t)X-%(t) = Q 

has a unique positive definite solution X(f) satisfying 

X(Q) = X, X(l) = X. 

By Lemma l4~Tl . we have 



r dx(t)w< f 

Jo Jo 

m in 

, iP^iWAMWWdAMW) H 2/?2(||A,|| + f||AA,l|)||AA,|| 



||X-X|| = ||X(1)-X(0)|| = || dX(t)\\< \\dX(t)\\ 

Jo Jo 



-dt. 



* f ^ 

/? 2 - 2(||A,|| + r||AA,l|) 2 J ° ^-XdlA.H + fllAA.H) 2 

1=1 1=1 

By mean value theorem of integration, there exists s e [0, 1] satisfying 

in in 

i 2/? 2 CIU4.il] + fllAAilDHMfll 2 2 y 6(||A,|| + e ||AA,||)||AA,| 

||X-X|| < | — — </?= — 

J ° 1 - I(I|A»|| + f||AA,||) 2 jS 2 - KIlAfH + e ||AA,||) 2 

!=1 1=1 

m 

2 2AIIA/H + ||AA,||)||AA,|| 
< tl . 

— m 

B 2 - ZdlAII + IIAAill) 2 

1=1 



Next, based on the operator theory, we derive a sharper perturbation estimate. 
Subtracting ( 11.11 ) from ( 14.11 ) we have 



i=l 

where 



□ 



AX + ^ B'AXBj = E + h(AX), (4.8) 



fi, = X _1 A;, 

m m 

£ = ^(B*AA, + AA*B,) + AA'X^AAi + AQ, 

i=\ i=l 

m m 

h(AX) = Yj B*AXX l AX(I + X-'AXr'fi,- - ^ A-X' 1 AX(I + X' 1 AXr'X" 1 AA,- 

1=1 1=1 

m 

- Y AA;x _I AX(7 + X" 1 AX) _I B/. 

i=l 
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We define the linear operator L: <H nxn — » <7Y" X " by 

m 

LW = W + Y J B*WBj, W e <H nxn . 

i=i 

Since 

m m m 

X- ^ B*XBi = X- ^ A-X^XX^Ai =X- ^A-X^A/ = Q > 0, 

i=l ;=1 i=l 



by Lemma 3.4.1 and Proposition 3.3.1 in 1250 . the operator L is invertible. We also define 
operators P, : C" x " -> "H nX " by 

P,Z, = L _1 (S*Zi + Z*B,), Z ; e C" x ", z = 1,2, ■ • • ,m. 
Thus, we can rewrite (14. 8t as 

m m 

AX = L~'Ag + y P/AA; + L _1 (Y AA*^'AA,) + L^^AX)). (4.9) 

i=i i=i 

Define 

III- 1 1 1 = max HL-'WII, ||P,|| = max ||P,Z||. 
W e ( H nxn Z e C" x " 

l|W|| = 1 ||Z|| = 1 

Now we denote 

m 

l = IlL- 1 !!- 1 , f = ||X- 1 ||, m i = \\A i \\, nt = \\n\, ft = Pill, = J] ftf, i = 1,2, ■ • • ,m, 

(=1 

• m „ „ m 

e = y||Aei| + J](«,||AA,|| + |||AA,|| 2 ), cr = + ||AA,||K + 0,)l|AA,l|. 

Then we can state the third perturbation estimate as follows. 
Theorem 4.3. // 

1(1 -cr) 2 

cr < 1 ana! e< (4.10) 

((I + lcr + 20 + 2 V(/cr + 0)(0 + /)) 

fnen 

2/e 

P - XII £ ,, = ft- 

f(l + - cr) + V^ 2 (l + Je - of - Al£e(l + 6) 

Proof. Let 

m m 

f(AX) = L^AQ + V P,AA ; + L _1 (y AA*X~ 1 AA i ) + L _1 (/i(AX)). 

i=l i=l 

Obviously, / : 7f nXB — > <7Y" X " is continuous. The condition ( 14.101 ) ensures that the quadratic 
equation ((I + 9)^ 2 — 1(1 + - cr)% + le = with respect to the variable £ has two positive real 
roots. The smaller one is 

2le 

ft = 



1(1 +(e-o-)+ V' 2 (l + - o-) 2 - +l(e(l + 6) 
13 



Define Q = {AX e <H nxn : \\AX\\ < £}. Then for any AX e Q, by (l4~T0b . we have 

lie 



llx- I AX||<pr 1 ||||AX||<£6 <(■ 



1(1 + £e-&) 



_ | ftr + o--l < | -2(l-o-)(/ - + g) 

1+fe-cr" (Zcr + Z + 20)(1 + £e - cf) 

It follows that / - X~ l AX is nonsingular and 

1 1 



WI-X^AXW < 



l-VX-iAXW ~ l-f||AX|| 
Therefore, we have 

" .2 ^HA^II 2 



1 £ 1 Z1I 

||/(AX)]| < y||Aei| + 2(«,||AA,|| + i||AA,|| 2 ) + y2^_^ 

1=1 i=l 

+ y £ K«"< + ll^'H) + ^ 11^10 • Y^Kx\\ 

gjlAXjj ^||AX|| 2 
< e + — — — + 



i -am Ki -am) 

, ^ Oft , > 

< eH = c 3 , 

for AX e Q. That is f(£l) Q O. According to Schauder fixed point theorem, there exists AX, e Q. 
such that /(AX*) = AX,. It follows thatX + AX, is a Hermitian solution of Eq.( l4. lb . By Theorem 
X2l we know that the solution of Eq.gTQ) is unique. Then AX, = X - X and ||X - X|| < f 3 . □ 



Remark 4.2. from Theorem \4.3\ we get the first order perturbation bound for the solution as 
follows: 

, m 

IIX - X|| < yllAfiH + J] n,||AA,|| + (9 (\\(AA U AA 2 , • • • , AA m , A0|| 2 ) , 

i=l 

as (AAi, AA 2 , ■ • • , AA,„, Ag) -> 0. 
Combining this with \4.9\ gives 

in 

AX - L l AQ + L 1 ^(B'AAi + AA*fi,) + O (||(AAi, AA 2 , ■ ■ • , AA m , A0|| 2 ) . 
as (AAi, AA 2 , • ■ ■ , AA m , AQ) -> 0, 
5. Backward error 

In this section, we derive a backward error of an approximate solution for the unique solution 
to Eq. (II . lb beginning with the lemma. 
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Lemma 5.1. For every positive definite matrix X e <H nXi \ (fx + AX > (l/v)I > 0, then 

m m 

\\J]a*((x + Axy 1 -x-^AiU <(\\ax\\ + v\\ax\\ 2 )Y,\\ x ' 1a 'W 2 - 

i=l 1=1 
Proof. According to 

(x + Axy 1 - x _1 = -x~ 1 ax(x + Axy 1 = -x^axx^ 1 + x- 1 axx~ 1 ax(x + Axy\ 

it follows that 

m 

Wj^A^iX + AXy 1 -X- l )Ai\\ 
1=1 

m 

< Yfl^'X" 1 AXX~ l Ai\\ + \\A*X- X AXX~ l AX(X + AX) _1 A,||) 
i=i 

m 

(\\AX\\ + v\\AX\\ 2 )J]\\ X ' lA '\\ 2 - 



i=i 

< 



1=1 

□ 

Theorem 5.1. Let X > be an approximation to the solution X of Eg. ( 17771 ). If the residual 

m 

R(X) = Q+Ij A'X^Ai - X satisfies 

1=1 

\\R(X)\\ < r- ^mi„W, where Z = V pr%f < 1, (5.1) 

f/zen 

||X-X||<0||tf(X)||, (5.2) 

where 

2A m i n (X) 



6 = 



(1 - EHrfnGO + + ^((1 - ZM rain (X) + IITOH) 2 - 4i min (X)||/?(X)|| 

Proof. Let 

*F = {AX e "H* x " : ||AX|| < 6>P(X)||}. 
Obviously, *P is a nonempty bounded convex closed set. Let 

m 

g(AX) = ^]A*[(X + AX) _I -X ^Ai+R(X). 

i=l 

Evidently g : i-> r J-(" xn is continuous. 

Note that the condition ( 15.11 ) ensures that the quadratical equation 

x 2 - (^(5X1 - Z) + \\R(X)\\)x + A min (X)\\R(X)\\ = 
15 



has two positive real roots, and the smaller one is given by 

2A min (X)\\R(X)\\ 



(1 - Z)A min (X) + ITOII + ^((1 - Z)4nffl + W(X)\\) 2 - 4A mm (X)\\R(X)\\ 



Next, we will prove that gC¥) £ *P. 
For every AX e we have 

AX > -e\\R(X)\\I. 

Hence 

X + AX >X - 6\\R{X)\\I > (A mm (X) - e\\R(X)\\)I. 

By (15.2l i. one sees that 



(l-E>l min (X) + »)ll 
According to ( 15. U . we obtain 



f i | iron-(i-£M min (x) ) 

(1 - mmin(X) + \\R(X)\\ 



\\R(X)\\ - (1 - Z)A mm (X) < I (1 ^ - (1 - X)) WS) < 2(1 < 0, 

which implies that 

eilTOH < A min (X) and (^(5) - 9\\R(X)\\)I > 0. 
According to Lemma IBTTl we obtain 
\\g(AX)\\ 

< (\\AX\\ + V \\X- l Ai\\ 2 + \\R(X)\\ 

\ A min (X)-9\\R(X)\\)j^ 

\2 



< U| + J«lL) s+ roii 



A rain (X)-0||fl(X)||, 

= eraii- 

By Brouwer's fixed point theorem, there exists a AX e *P such that g(AX) = AX. Hence X + AX 
is a solution of Eq. dl.U . Moreover, by Theorem l3.2l we know that the solution X of Eq. dl.U is 
unique. Then 

\\x-x\\ = \\ax\\<o\\R(x)\\. 

□ 

6. Condition number 



In this section, we apply the theory of condition number developed by Rice 02611 to study 
condition number of the unique solution to Eq. (11.11 ). 
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6.1. The complex case 

Suppose that X and X are the solutions of Eg. (11. U and Eg. ( 14. lb . respectively. Let AA = A- A, 
AQ = Q — Q and AX - X -X. Using TheoremH31and Remark|421 we have 



AX = X - X = L 1 AQ + L 1 ]T(B*AAi + AA-fi,) + (||(AA l7 AA 2 , • • ■ , AA m , AQ)|£) , (6.1) 



1=1 



as(AAi,AA 2 ,--- ,AA m ,AQ) 0. 

By the theory of condition number developed by Rice |26j], we define the condition number 
of the Hermitian positive definite solution X to Eg. dl.U by 



c(a) = hm sup , 



(6.2) 



where p and 77,-, i — 1,2, •• • , m, are positive parameters. Taking £ = rj, ■ - p - 1 in ( 16.21 ) gives 
the absolute condition number c a b s (X), and taking £ = , 77/ = \\Ai\\f and p = \\Q\\f m ( 16.2b 
gives the relative condition number c re i(X). 
Substituting ( 16.11 ) into ( 16.21 ). we get 



c(X) 



max 



\\L-\AQ+Z(B;AA i + AA*Bd)\\ F 
i=l 

AA,„ AQ s 



AA,- e C" x ", Ag e <7Y" X " 



= - max . 

£ i eC" x ",//e'H" x " 

Let L be the matrix representation of the linear operator L. Then it is easy to see that 

m m 

L = I ® / + YbJ ® B* = I ® / + Y(Z _1 A / ) r ® (X _1 A;)*. 



1=1 



Let 



ZT 1 = S + iE, 

L-\l®B*) = L _1 (7® (X^A,)*) = C/n + iQa, 
L _1 (Bf ® J)n = ^((X^A,) 7 ® I)U = U i2 + iQ ;2 , 



Sc = 



S -E 
E 5 



C/a + C/ a Qq - 



, i = 1 , 2, • • • , m, 



(6.3) 



vecH-x + iy, vecZ?; = a* + ifo;, g = (jc r ,y r , Aj, b[ , ■ ■ • , a 7 , fr 7 ) 7 , M = (Ei,E2, ■■■ ,E m ,H), 



% 2 



where x, y, a„ bi e 9?"" , S,E, t/,i, t//2,fi,i,Q/2 e 9?" " x " , i= \,2,--- ,m, n is the vec -permutation 
matrix, such that 

vec Ef = n vec 
17 



Furthermore, we obtain that 

m 

. WL^ipH + 2 r]i{B*Ei + E*Bi))\\f 

c(X) = — max 

£ M + Q \\{E\,E 2 ,- ■ ■ ,E m ,H)\\ F 

m 

\\pL- [ vecH + £ ViL^ii 1 ® B*)vecEi + (Bj ® 7)vec£ , *)|| 
? jVf ^ o ll(vecJ?i, vecE 2 , ■■■ , vecE m , \ecH)\\ 

m 

\\ P (S + + iy) + 2 ij,[(t7 fl + WaXflj + + (V a + if2 a )(a, - 

1 i=l 

= - max 

£, m t ll(vec£i , vec£ 2 , • • • , vec£ m , vecH)|| 

1 \\(p ScTjiUumUi,- ■ ■ ,r]mU m )g\\ 
= - max 

= i Il(p5 c , 771 C/i, Jft^ 2 ," • ,rj m U m )\\, E i eC n * n ,H€<H n * n . 
Then we have the following theorem. 

Theorem 6.1. The condition number c(X) defined by ( 16.21 ) has the explicit expression 

c(X) = - || (pS c , mUu mUi,-- ,r} m U m )\\, (6.4) 



where the matrices S c and U/ are defined as in ( I6.il ). 

Remark 6.1. From \6.4\ we have the relative condition number 

™ II (MMfSc: ^Wf Uu \\A2hU2, \\A m \\ F U„ 

C re l(X) = 



\\x\\ F 

6.2. The real case 

In this subsection we consider the real case, i.e., all the coefficient matrices A,, Q of Eq. fll.U 
are real. In such a case the corresponding solution X is also real. Completely similar arguments 
as Theorem l6.1| give the following theorem. 

Theorem 6.2. Let A,-, Q be real and c(X) be the condition number defined by ( 16.21 ). Then c(X) 
has the explicit expression 

1 

c(x) = - || (pS r , mU\, mUi,-- ■ ,r] m u m ) \\, 



where 



f m 

S r = \l + Y J {A T i X- x )®{A T i X- 1 ) 



u i = s r [i®{A}x- 1 ) + {{A T i x- 1 )®r)n\ > i = 1,2,-- 

Remark 6.2. In the real case the relative condition number is given by 

™ HWQhSr, Mdb Uu \\A 2 \\ F U 2 ,--- ,\\A m \\ F U„ 

CreliX) = 



\\X\\ F 
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7. Numerical Examples 



To illustrate the theoretical results of the previous sections, in this section four simple exam- 
ples are given, which were carried out using MATLAB 7.1. For the stopping criterion we take 

m 

s k+1 (X) = \\X - 2 - /|| < l.Oe - 10. 

i=i 

Example 7.1. We study the matrix equation 

X-A\X- l A x -A* 2 X- 1 A 2 = I, 

with 



l 

k+2 





< 2 


1 








1 


-2 


1 


2 


1 








-A, k = 1,2, A = 





1 


2 


1 













1 


2 


1 




k 








1 


2 , 



By computation, B — 1.0009, a — 1.1976. Let Xq = 1.1/. Algorithm \3. li needs 11 iterations to 
obtain the unique positive definite solution 



X = 



1.0643 0.0494 0.0104 -0.0009 -0.0000 ^ 

0.0494 1.0747 0.0485 0.0104 -0.0009 

0.0104 0.0485 1.0747 0.0485 0.0104 

-0.0009 0.0104 0.0485 1.0747 0.0494 

-0.0000 -0.0009 0.0104 0.0494 1.0643 



e [BI, al] 



with the residual \\X — A^X A\ — A* 2 X l A 2 — I\\ — 4.8477e — 01 1, which satisfies Theorem \3.2 
and Theorem\3.4\ 



Example 7.2. We consider the matrix equation 

X - A\X~ l Ai - A* 2 X- l A 2 = /, 



with 



+ 2 x 10" 2 



IAII 



-A, A 2 





f 2 


1 








^ 


■2 


1 


2 


1 








-A, A = 





1 


2 


1 













1 


2 


1 




I 








1 


2 , 



Suppose that the coefficient matrices A\ and A 2 are perturbed to A/ = A/ + AA,-, i — 1,2, where 
Mi = 



10^' T 3 x lO^ 1 T 

-(C T + C), AA 2 = ———{C T + C) 



\\c T + c\\ K 



\\C T + C\\ 



and C is a random matrix generated by MATLAB function randn. 

We now consider the corresponding perturbation bounds for the solution X in Theorem \4.1 
Theorem\4.2\and Theorem\4.3\ 
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The conditions in Theorem \4.1\ are 

2 

con\ = 2B 2 - b > 0, con! = B 2 - ^ ||A,|| 2 > 0, 

2 2 

co«3 = 06 2 - 2 ll A 'H 2 ) 2 - 4 ^ Z l|AA '" (2||Ail1 + l|AA,ll) " °- 
77ze condition in Theorem \4.2\ is 

2 

CO »4=/? 2 -£(||A,|| + ||AA,||) 2 >0. 

i=i 

The conditions in Theorem \4.3\ are 

1(1 - a-) 2 

con5 — 1 — cr > 0, con6 = . — e > 0. 

f (/ + /o- + 26 + 2 V(/cr + ff)(8 + 1)) 

By computation, we list them in Table\l] 



Table 1: Conditions for Example l7.2l with different values of j 

4 5 6 7 



conl 


1.1650 


1.1650 


1.1650 


1.1650 


con2 


0.8379 


0.8379 


0.8379 


0.8379 


con3 


0.7018 


0.7021 


0.7021 


0.7021 


conA 


0.8378 


0.8379 


0.8379 


0.8379 


con5 


0.9999 


1.0000 


1.0000 


1.0000 


con6 


0.4802 


0.4804 


0.4804 


0.4804 



The results listed in Table\l\show that the conditions of Theorem \4.1\ \4~3\ a re satisfied. 

By Theorem \4.1$4.3\ we can compute the relative perturbation bounds ^\,^v t = re- 
spectively. These results averaged as the geometric mean of 20 randomly perturbed runs. Some 
results are listed in Table\2\ 



Table 2: Results for Example l7.2l with different values of j 



j 


4 




5 




6 




7 




2.7093 x 10 


-5 


2.5933 x 10" 


-6 


2.5409 x 10" 


-7 


2.5031 x 10~ 8 


ft 


9.9282 x 10 


-5 


9.9853 x 10 


-6 


9.7137 x 10" 


-7 


9.8301 x 10~ 8 


ft 


8.6930 x 10 


-5 


8.7421 x 10" 


-6 


8.5042 x 10" 


-7 


8.6061 x 10~ 8 


v* 


6.4687 x 10 


-5 


6.5057 x 10" 


-6 


6.3287 x 10" 


-7 


6.4045 x 10" 8 



The results listed in Table [2] show that the perturbation bound v» given by Theorem \4.3\ is 
fairly sharp, the bound £2 given by Theorem \4.2\ is relatively sharp, while the bound £1 given by 
Theorem \4. 1 1 which does not depend on the exact solution is conservative. 
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Example 7.3. We consider 

X-A\X~ l A] -A* 2 X~ 1 A 2 = Q, 



with 



M = 



+ 2 x 10~ 2 



-A, A 2 = 



+ 3 x 1(T 2 



IIAII 



-A, Q=A = 



( 2 1 ^ 
12 10 
12 10 
12 1 
1 2 



Choose Xo — A. Let the approximate solution X k of X be given with the iterative method ( 15.71 ) 
where k is the iterative number. 

The residual R(X k ) = Q + A\X k l Ai + A^XZ A2 — %k satisfies the conditions in Theorem \5.1 
By Theorem \5.1\ we can compute the backward error bound for X k 



where 



X k - X ||< 6\\R{X k )\\, 



2/t m in(X) 



(1 - Z)A mia (X k ) + \\R(X k )\\ + ^((1 - Z)A mn (X k ) + \\R(X k )\\) 2 ~ ^ mm (X k )\\R(X k )\\ 
Some results are listed in Tabl$3] 

Table 3: Results for Example l7.3l with different values of k 



k 


1 


2 


3 


4 


Wk-X\\ 


5.0268 x 10~ 4 


5.7662 x 10~ 6 


6.6162 x 10~ 8 


7.5024 x 10~ 10 


e\\R(x k )\\ 


5.1435 x 10~ 4 


5.9000 x 10~ 6 


6.7689 x 10~ 8 


7.7656 x 10" 10 



The results listed in Table\3\show that the error bound given by Theorem \5.1\ is fairly sharp. 
Example 7.4. We study the matrix equation 

X-A\X~ l Ai -A* 2 X~ l A 2 = Q, 

with 



4~ + 2 x 10- 





{ 2 


1 








\ 




{ 2 


1 





9 


1 


■k 


1 


2 


1 










l 


2 


1 





8 


-A, j = 1,2, A = 





1 


2 


1 





, Q = 


5 


1 


2 


1 


6 










1 


2 


1 




9 





1 


2 


1 




, 








1 


2 ) 




, 


2 


3 


1 


2 , 



By Remark \6.2\ we can compute the relative condition number c re i(X). Some results are listed in 
Tabled 

The numerical results listed in the second line show that the unique positive definite solution 
X is well-conditioned. 
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Table 4: Results for Example l7.4l with different values of k 



k 


1 


3 


5 


7 


9 


Crel(X) 


1.2704 


1.0951 


1.0939 


1.0938 


1.0938 
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